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Let Ax^b be a consistent system of linear inequalities. The principal result is a 
quantitative formulation of the fact that if jc ' 'almost" satisfies the inequalities, then x is 
''close" to a solution. It is further shown how it is possible in certain cases to estimate the 
size of the vector joining x to the nearest solution from the magnitude of the positive 
coordinates of Ax — b. 



1. Introduction 

In many computational schemes for solving a 
system of linear inequalities 



Ai-x=anXi + 



+ ainXn^hi 



(1) 



Ara-X — dmlXl-^ . . . -\r dynnXn =bn, 



(briefly, Ax^h), one arrives at a vector jc that 
^'almost'^ satisfies (1). It is almost obvious geo- 
metrically that, if (1) is consistent, one can infer 
that there is a sohition Xq of (1) ^VJose'' to x. The 
purpose of this report is to justify and formulate 
precisely this assertion.^ We shall use fairly general 
definitions of functions that measure the size of 
vectors, since it may be possible to obtain better 
estimates of the constant c (whose important role 
is described in the statement of the theorem) for 
some measuring functions than for others. We shall 
make a few remarks on the estimation of c after 
completing the proof of the main theorem. 

2. The Main Theorem 

We require the following 
Definitions: 

For any real number a, we define 
a if a > 



ifa<0. 



For any vector y=(yu . . -, Vk), we define 



(2) 



A positive homogeneous function F^ defined on 
A:-space is a real continuous function satisfying 

(i) Fk{x)'^0, F„{x) = Oii, and only if, x=0 



(ii) 



a ^ implies Fjc{ax) = aFjc{x) 



(3) 



*This work was sponsored (in part) by the Office of Scientific Eesearch, USAF. 

1 A. M. Ostrowski has kindly pointed out that part of the results given below 
is implied by the fact that if K and L are two convex bodies each of which is in 
a small neighborhood of the other, then their associated gauge functions differ 
slightly. 



Theorem: Let (1) he a consistent system oj ine- 
qualities and let Fn and F^ each satisfy (3). Then 
there exists a constant c>0 such that for any x there 
exists a solution XqoJ (1) with 

Fn{x-x,)ScF^{Ax-h)^), 

The proof is essentially contained in two lemmas 
(2 and 3 below) given by Shmuel Agmon.- 

Lemma I. If F^ satisfies (3), there exists an 6>0 
such that for every y and every subset S of the half 
spaces (1) 

FUy)^eFUy) 

where y={yi, . . . ,?/J, y={yi,. . .,ym), (ind 
yi if the ^th half space belongs to S 



yr- 



otherwise. 



Proof. It is clear from (3) (i) that any e will 
suffice for 17=0. By (3) (ii), we need only consider 
the ratio Fm(y)/F^{y) for y such that F{y) = l, a 
compact set. Hence, for each subset S, Fj(y)IFm{y) 
has a maximum Cs. Set e=max Cs^ 

Lemma 2. Let 12 he the set of solutions of (1), lei 
X he a point exterior to 12, and let y he the point in 12 
nearest to x. Let S he the subset of the half spaces 
(1), each of which contains y in its bounding hyper- 
plane, and let 12^ he the intersection of these half spaces. 

Then x is exterior to 12^ and y is the nearest point 
of 12s to X. 

Lemma 3. Let M he anmXn matrix obtained from 
A by substituting for some of the rows of A, and 
let 12 he the cone of solutions of Mz^O. Let E be 
the set of all points x such that (i) x is exterior to 12, 
and (ii) the origin is the point of 12 nearest to x. 
Then there exists a ds^O such that XeE implies 

F^{{Mxy)^dsFn{x). 

Proof of the theorem. Let x be any vector exterior 
to the solutions 12 of (1), let jCq be the point of 12 near- 
est to JC, and let S be defined as in lemma 2. 

Let M be the matrix obtained from A by substitut- 

2 S. Agmon, The relaxation method for linear inequalities, National Applied 
Mathematics Laboratory Report 52-27, NBS (prepublication copy). 
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ing for the rows not in S, and let 6 be the vector 
obtained from b by substituting for the components 
not contained in S. 

Then lemma 2 says that Xq satisfies Mz=b, x is 
exterior to the solutions of Mz^by and jCq is the 
solution of Mz^b nearest to x^ Perform the trans- 
lation z^ = z—Xo. Then Mz^b if, and only if, 

Mz'=Mz-Mxo=Mz-l}^0. 

Thus x—Xq belongs to the set E of lemma 3, and 

FMMx-b)^)=FMM{x-Xo))^)^dsFr,{x-Xo)^ 
dFn{x-Xo), 

where d=min ds. 

s 

Thus, 

F,(x-Xo)^lFm(Mx-b)^^F^{{Ax-by), 

using lemma 1. Setting c=e/d completes the proof of 
the theorem. 

3. Estimates of c for various norms 

None of the estimates to be obtained is satisfac- 
tory, since each requires an inordinate amount of 
computation except in special cases. It is worth 
remarking, however, that even without knowledge 
of the size of c, the theorem is of use in insuring that 
any computation scheme that makes (Ax—b)'^ 
approach will bring x close to the set of solutions of 
(1). This guarantees, for instance, that in Brown's 
method for solving games the computed strategy 
vector is approaching the set of optimal strategy 
vectors. 

In what follows let 

\'x\ = maximum of the absolute values of 
the coordinates of x; 

\\x\\ =sum of the absolute values of the co- 
ordinates of jc ; 

I I |jk;| I | = the square root of the sum of the 
squares of the coordinates of x. 

Note that if F^^ is any one of these norms, then 
e=l. We consider these cases : 

Case I. i^,= ||| II!, F^=\ 
square matrix of rth order, let 



|. If C={Cij) is a 



r(C)=[g (± lOuiyj 



where the Ci/s are the cofactors of the elements of 
Cfj. Using this notation, and assuming that the 

n 

rows of (1) are normalized so that X) <^i/=lj Agmon 
(see p. 9 of reference in footnote 2) has shown that if 



A is of rank r, then 

r S (^pii, . . . .jvvi^ 

rt < Li<ii< . . . <jr<n U il, . . . , ir) J 

~r X) \ Ah, . . . WV|21^ 

Ll<ji< . . . <jr<n 1^ Ji, . . . , j,| J 

where ii, . . ., ir are r (fixed) linearly independent 
rows of (aij); ^i|;;;;;^-; is the rXr submatrix 
formed b}" the fixed rows and indicated columns, and 
where the summation is performed over all different 
combinations of the/s. 

Case II. Fn=\ IF^=\ |. 

Casein. Fn=^\ IF^=\\ ||. 

For cases II and III, it is convenient to have a 
description of E alternative to that contained in 
lemma 3. We shall use the notation of lemma 3. 

Lemma 4. Let K'=^the cone spanned by the row 
vectors of M, with the origin deleted. Then K=E. 

Proof. LetAfi, . . ., M;« be the row vectors of M, 
and let JC=XiMi+ . . . +X„,M^, where jcf^ 0, and 
Xz^O, i=l, . . ., m. Then x is exterior to 12, and 
the origin is the point of 12 closest to jc; that is, z e 12 
implies {x—z)'{x—z)—x-x>0. For Z'X=^Z'(XiMi+ 
. . . +\^Mm)=\iZ'Mi+ . . . +\mZ'Mm^O. HcncG 
{x—z)-{x—z) — X'X=z-z—2Z'X^0. This shows that 
K' (IE. 

We now prove that E C.K\ Assume x eE. Then^ 



z el2 imphes z-x^O 



(4) 



(otherwise let whe o, sufficiently small positive num- 
ber; then w z eU and wz-wz—2wz-x<C0). Consider 
z as the coordinates of a half space whose bounding 
plane contains the origin. Then (4) says that all 
half spaces (^'through'' the origin) containing the row 
vectors of M also contain x. It is a fundamental 
result in the theory of linear inequalities ^ that this 
later statement implies that x is in the cone gener- 
ated by the rows of M. Hence E CK'. 

4. Case II 

It is clear from the proof of the theorem that all 
we need is to calculate min (|Mx)+|/|jc|), for each M 

XeE 

corresponding to a subset S of the vectors Ai, . . ., 
Arn. Let Ai, . . ., Afc (say) be the vectors of the 
subset S. Then by lemma 4, XeE implies that 
there exist Xi, . . ., X^ with X^-^O such that 



Hence, 



X — \iAi9^ . . . -l-X;;;^^. 



\x\^as J2h, 



(5) 
(6) 



where as is the largest absolute value of the co-ordi- 
nates of Ai, . . ., Ajc. 

It follows from the homogeneity of |(M;)c)+|/|;)c| that 

3 T. S. Motzkin, Beitrage aur Theorie der Linearen Ungleichungen. Jerusalem, 
1936, with references to proofs by Minkowski and Weyl. 
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max I 



we need only consider xeE such that if x is expressed 

k 

as in (5), Xl>^jf=l- 

3 = 1 

Then 

|CMjc)+|=max(ylrJc)+=max {Ai'X)= 

i i 

i \ ;=l / i j=i 

where gij=Ai' Aj,\j^O,'^\j=l. 
Hence, 

min |(Mjc)+l=minmax XI 9iAj='f^s, (7) 

X i ; = 1 

where z's is the value of zero sum two person game 
whose matrix is Qij. 

Therefore, from (6) and (7) 

. \{Mx)+\^vs 
mm '^ I I ' ^-^- 

Can y«,'=0? Clearly, if, and only if, the origin is in 
convex body spanned by Ai, . . ., Ak . But this 
would imply that the set E is the entire space (except 
for the origin) . And it follows from the proof of the 
main theorem that this can occur onl}^ for a subset 
S that would never arise in lemma 2. 

Therefore, using the language of the theorem 



where 



|;3C-JCo|^c|(^jc-6)+| 

as 
c=max — 

vs>0 ^S 



(8) 



A special case occurs when all Ai'Ajy>0. I^et 
^=min Ai'Aj, a=max \aij\. Then, 
i, J i, J 



|jc-JCo|^-|(^Jc-6)+|. 



(9) 



5. Case III 

Reasoning, along the lines of case II, we need only 

estimate min 1 1( S^u^; ) 1 1, and it is possible to derive 

from it an expression analogous to (8), which un- 
fortunately does not seem to have a neat statement 
in terms of games or any other familiar object. An 
interesting special case occurs, however, if the 
matrix gtj (for S all the rows of A), has the property 
that 



w=mMi 



Then 



mm 



V gii<o J 

/ k \+ k k 

\;=i / X i=i i=i 



k k k 

=min y^.\iy^,nii>mm y^,\iW=w. 

X ;=1 i=l X ;=1 

Then we obtain, with a having the same meaning as 
in (9) 



\x-Xo\^^\\{Ax-by\l 



(10) 



Washington, June 5, 1952. 
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